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(54) INFORMATION PROCESSING METHOD. INFORMATION PROCESSOR AND STORAGE 
MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an information 
processor that calculates which part of an image pickup 
possible area and how much an image pickup device 
picks up and that displays the result in a visually 
understandable way. 

SOLUTION: The information processing method 
processes information of an image pickup device that is 
controlled by an externa! device, includes a panorama 
image division process (SI 02) that divides an image 
pickup possible area of the image pickup device into a 
plurality of areas, area specification processes (S1 05- 
S108) that specify the area picked up by the image 
pickup device under a prescribed condition, and a 
statistic process (SI 09) that calculates a degree of 
correspondence to the image pickup area specified by 
the area specification processes as to each area divided 
by the area division process. 
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* NOTICES * 

JPO and )UP\T are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation 
may not reflect the original precisely. 

2, **** shows the word which can not be translated, 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

(Claim 1] The field division process of being the information processing 
approach for processing the information on controllable image pick-up 
equipment by the external device, and dividing into two or more fields 
the field of said image pick-up equipment which can be photoed, The 
information processing approach characterized by having the statistics 
process which computes whenever [ correspondence-with field 
specification process / of pinpointing the field which said image pick-up 
equipment photoed in predetermined conditions /, and photography field 
pinpointed in said field specification process about each field divided in 
said field division process 3- 

[Claim 2] It is the information processing approach according to claim 1 
which has further the time setting process which sets up the time 
amount photoed with said image pick-up equipment, and is 
characterized by said predetermined conditions being in the time 
amount set up in said time setting process. 



[Claim 3] It is the information processing approach according to claim 1 
which has further the count setting process of setting up the count 
photoed with said image pick-up equipment, and is characterized by 
said predetermined conditions being the counts of photography set up 
in said count setting process, 

[Claim 4] The information processing approach according to claim 1 to 3 
which has further the input process which inputs the number of 
partitions of said field which can be picturized, and is characterized by 
dividing said field which can be picturized into the number of partitions 
inputted at said input process at said field division process, 
[Claim 53 The information processing approach according to claim 1 to 4 
characterized by pinpointing the photoed field based on the control 
value used in order to control said image pick-up equipment by said 
field specification process, 

[Claim 6] Said control value is the information processing approach 
according to claim 5 characterized by being a value for controlling the 
pan of said image pick-up equipment, a tilt, and a zoom. 
[Claim 7] The information processing approach according to claim 1 to 8 
characterized by pinpointing the field photoed based on the log data of 
said image pick-up equipment at said field specification process, 
[Claim 8| Said statistics process is the information processing approach 
according to claim 1 to 7 characterized by having the comparison 
process which compares the photography field pinpointed in said 
specific process with two or more fields divided in said field division 
process, and the calculation process which computes whenever 
[ correspondence j based on the comparison result in said comparison 
process. 

[Claim 93 The information processing approach according to claim 1 to 8 
characterized by having further the display process which displays 



whenever [ correspondence / which was obtained according to said 
statistics process ] about each division fieSd. 
[Claim 10] The information processing approach according to claim 9 
characterized by expressing the numeric value which shows whenever 
[ said correspondence ] to each division field as said display process. 
[Claim 11] The information processing approach according to claim 9 
characterized by expressing a division field as different concentration 
according to whenever [ said correspondence ] at said display process, 
(Claim 12] The information processing approach according to claim 9 
characterized by expressing a division field as a different color 
according to whenever [ said correspondence ] at said display process. 
[Claim 13] The information processor carry out having a statistics 
means compute whenever [ correspondence-with field division means / 
are an information processor for processing the information on 
controllable image pick-up equipment by the external device, and divide 
into two or more fields the field of said image pick-up equipment which 
can be photoed /, field specification means / pinpoint the field which 
said image pick-up equipment photoed in predetermined conditions /, 
and photography field that said field specification means pinpointed 
about each fieid divided by said field division means 3 as the description, 
[Claim 14] It is the information processor according to claim 13 which 
has further a time setting means to set up the time amount photoed 
with said image pick-up equipment, and is characterized by said 
predetermined conditions being in the time amount set up with said time 
setting means. 

[Claim 15] It is the information processor according to claim 13 which 
has further a count setting means to set up the count photoed with said 
image pick-up equipment, and is characterized by said predetermined 
conditions being the counts of photography set up with said count 



setting means, 

[Claim 18] it is the information processor according to claim 13 to 15 
which has further an input means to input the number of partitions of 
said fieid which can be picturized, and is characterized by said field 
division means dividing said field which can be picturized into the 
number of partitions which said input means inputted. 
[Claim 17] Said fieid specification means is an information processor 
according to claim 13 to 16 characterized by pinpointing the photoed 
field based on the control value used in order to control said image 
pick-up equipment, 

[Claim 18] Said control value is an information processor according to 
claim 17 characterized by being a value for controlling the pan of said 
image pick-up equipment, a tilt, and a zoom, 

[Claim 19] Said field specification means is an information processor 
according to claim 13 to 18 characterized by pinpointing the field 
photoed based on the log data of said image pick-up equipment, 
[Claim 20] Said statistics means is an information processor according 
to claim 13 to 19 characterized by having a comparison means to 
compare the photography field which said specific means pinpointed 
with two or more fields which said Field division means divided, and a 
calculation means to compute whenever [ correspondence ] based on 
the comparison result in said comparison means. 
[Claim 21] The information processor according to claim 13 to 20 
characterized by having further a display means to display whenever 
[ correspondence / which was obtained by said statistics means ] about 
each division field. 

[Claim 22] Said display means is an information processor according to 
claim 21 characterized by displaying the numeric value which shows 
whenever [ said correspondence ] on each division field. 



[Claim 23] Said display means is an information processor according to 
claim 21 characterized by expressing a division field as different 
concentration according to whenever [ said correspondence j. 
[Claim 24] Said display means is an information processor according to 
claim 21 characterized by expressing a division field as a different color 
according to whenever [ said correspondence ]. 
[Claim 25] The storage holding the program code for realizing the 
information processing approach according to claim 1 to 12. 

DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the invention) This invention is a thing about the storage which 
memorized the program which performs the information processing 
approach of image pick-up equipment, and an information processor and 
said approach. When image pick-up equipment has especially the large 
field which can be picturized, it processes statistically where [ of the 
field which can be picturized / most ] were photoed, it is related with 
the information processing approach of the possible image pick-up 
equipment of displaying the result intelligibly, an information processor, 
and the storage that memorized the program which performs said 
approach. 
[0002] 

[Description of the Prior Art] A camera is connected to networks, such 
as the Internet, a pan, a tilt, and a zoom are controlled from remoteness, 
and transmission and the remote monitoring system to browse exist the 
image acquired with the camera through a network. As a camera used by 



such system, from Canon, inc., it connected with camera VC-C1, the 
VC-C3 grade, and the computer, and the controllable camera has 
appeared. Such a system is shown in JP,1G»422?9A 
[0003] Drawing 6 is drawing showing an example of the screen of the 
computer by which the conventional viewer for controlling a camera is 
operating. 801 is a WWW (World Wide Web) browser program and is 
Navigator of Netscape, and internet of Microsoft. There is Explorer etc. 
802 is a viewer program window which operates within the viewing area 
of a WWW browser program. The scroll bar for ( 803 ] tilts (vertical 
swing of a camera) in a graphic display aperture and 804, the scroll bar 
for pans {horizontal swing of a camera) in 805, the scroll bar for zoom in 
806, and 807 are the carbon buttons for the demand of a camera control, 
808 is a part which displays the condition of a camera control, and 809 
is a carbon button for backlight, amendment. The user was controlling 
the sense and zoom of a camera a scroll bar 804,805,806 and by 
operating a carbon button 807,809, looking at the graphic display 
aperture 803. By this, a part of field range of a camera which can be 
picturized will be chosen, and it will be displayed on the graphic display 
aperture 803, 

[0004] Moreover, it is also possible to photo the selected image pick-up 
range and to display on the graphic display aperture 803 by choosing the 
image pick-up range from the panorama image which displays all the 
fields of a camera like drawing 7 that can be picturized, computing 
parameters, such as a pan for phototng the image pick-up range, a tilt, 
and a zoom, and directing to a camera. Such a system is indicated by 
Japanese Patent Application No. 10-268603. 
[0005] The statistical information of fundamental access how much 
number of accesses there was when and most access from where there 
is is processed as a tool which, on the other hand, totals the access 



statistics of a Web server which is carrying out current spread, and 

there are some which are displayed, 

[0006] 

[ProbSem(s) to be Solved by the Invention] In the above systems, since 
two or more clients can operate a camera from remoteness through a 
network, there is a request of wanting to know which hit of the range of 
a camera which can be picturized being photoed most frequently as a 
result of the actuation. 

(00071 This invention is made in view of the above-mentioned trouble, 
and it aims at image pick-up equipment offering the information 
processing approach of image pick-up equipment which st computes 
which part of the field which can be picturized was picturized how much, 
and can display the result intelligibly visually, an information processing 
means, and the storage which memorized the program which performs 
said approach, 
[0008] 

[Means for Solving the Problem] In order to solve the above-mentioned 
technical problem, the information processing approach for processing 
the information on controllable image pick-up equipment by the external 
device of this invention The field division process of dividing into two or 
more fields the field of said image pick-up equipment which can be 
photoed, It. has the statistics process which computes whenever 
[ correspondence-with field specification process / of pinpointing the 
field which said image pick-up equipment photoed in predetermined 
conditions /, and photography field pinpointed in said field specification 
process about each field divided in said field division process ]. 
[0009] Having further the time setting process which sets up preferably 
the time amount photoed with said image pick-up equipment, said 
predetermined conditions are in the time amount set up in said time 



setting process. Or it has further the count setting process of setting 
up the count photoed with said image pick-up equipment, and said 
predetermined conditions are the counts of photography set up in said 
count setting process, 

[0010] Moreover, it has further preferably the input process which 
inputs the number of partitions of said field which can be picturized, and 
said field which can he picturized is divided into the number of 
partitions inputted at said input process at said field division process, 
(001 II Moreover, at said field specification process, the photoed field is 
preferably pinpointed based on the control value used in order to 
control said image pick-up equipment. Furthermore, said control value 
is a value for controlling the pan of said image pick-up equipment, a tilt 
and a zoom preferably. 

(00121 Moreover, at said field specification process, the field photoed 
based on the log data of said image pick-up equipment is pinpointed 
preferably. 

[0013] Moreover, said statistics process has preferably the comparison 
process which compares the photography field pinpointed in said 
specific process with two or more fields divided in said field division 
process, and the calculation process which computes whenever 
( correspondence ] based on the comparison result in said comparison 
process. 

[0014] Moreover, it has further the display process which displays 
preferably whenever [ correspondence / which was obtained according 
to said statistics process ] about each division field, and the numeric 
value which shows whenever [ said correspondence ] is expressed to 
each division field as said display process in more detail. Or a division 
field is expressed as the different concentration or the different color 
according to whenever [ said correspondence j- 



[0015] Furthermore, the information processor for processing the 
information on controllable image pick-up equipment by the externa! 
device of this invention has a statistics means compute whenever 
[ correspondence-with field division means / divide into two or more 
fields the field of said image pick-up equipment which can be photoed /, 
field specification means / pinpoint the field where said image pick-up 
equipment took a photograph in predetermined conditions /, and 
photography field that said field specification means pinpointed about 
each field divided by said field division means ), 
1001 6] Having further a time setting means to set up preferably the time 
amount photoed with said image pick-up equipment,, said predetermined 
conditions are in the time amount set up with said time setting means. 
Or it has further a count setting means to set up the count photoed with 
said image pick-up equipment, and said predetermined conditions are 
the counts of photography set up with said count setting means. 
[0017] Moreover, it has further preferably an input means to input the 
number of partitions of said field which can be picturized, and said field 
division means divides said field which can be picturized into the 
number of partitions which said input means inputted. 
[0018] Moreover, said field specification means pinpoints the photoed 
field preferably based on the control value used in order to control said 
image pick-up equipment. Furthermore, said control value is a value for 
controlling the pan of said image pick-up equipment, a tilt, and a zoom 
preferably. 

[00193 Moreover, said field specification means pinpoints preferably the 
field photoed based on the log data of said image pick-up equipment. 
[0020] Moreover, said statistics means has preferably a comparison 
means to compare the photography field which said specific means 
pinpointed with two or more fields which said field division means 



divided, and a calculation means to compute whenever 

[ correspondence ] based on the comparison result in said comparison 

means. 

[0021] Moreover, it has further a display means to display preferably 
whenever [ correspondence / which was obtained by said statistics 
means ] about each division field, and said display means displays in 
more detail the numeric value which shows whenever [ said 
correspondence J on each division field. Or a division field is expressed 
as the different concentration or the different color according to 
whenever [ said correspondence }< 
[0022] 

[Embodiment of the Invention] Hereafter, the gestalt of suitable 
operation of this invention is explained to a detail with reference to an 
accompanying drawing. 

[0023] Drawing 1 is the block diagram showing the image pick-up 
structure of a system in the gestalt of operation of this invention. In 
this drawing, 101 is image pick-up equipment and uses the camera in 
which remote control is possible. 102 is a camera server, and a personal 
computer is used as the base, it realizes, and it is connected to a 
camera 101. The camera server 102 controls a camera 101 by the 
camera-control server including the camera -control server 103 and the 
image server 104. Moreover, the image server 104 carries out the 
capture of the image of a camera 101. This camera server 102 can be 
used connecting with a network, and From the external computer 
connected through a network in that case, it can receive the parameter 
for camera control, and a camera 101 can be controlled by the 
camera-control server 103., and it can transmit the image which carried 
out the capture by the image server 104 based on that parameter to an 
external computer through a network. Mom detailed explanation of this 



camera server 102 is indicated by JP.10-42279A 
[0024] Moreover, 105 is a client machine, uses a persona! computer as 
the base and is realized. In a client machine 105, data [ need / CPU and 
107 / for a program and activation for ROM and 108 to be RAM a 
communication interface and 109, and for an input/output interface and 
112 realize the gestait of this operation to RAM112 / 106 ] are stored. 
Specifically, the field number-of-partitions input section 309 of a 
panorama image, the addition information preservation section 310, the 
analysis time zone input section 311, the analysis time zone attaching 
part 312, the record reading section 313 Chat reads the control log 
stored in the file system 305, the field partition section 314, the 
analysis time zone check section 315, the parameter transducer 316, 
the adder unit 317, and the addition information -display section 31.8 
grade are memorized. In addition, the field number-of-partitions input 
section 309 and the analysis time zone input section 311 constitute the 
user interface with the display 111, demand the input of the field 
number of partitions and the analysis time zone which are mentioned 
later from a user, or carry out actuation which Incorporates the 
inputted value. 

[0025] Moreover, 110 is a display and 111 is control units, such as a 
mouse and a keyboard. Moreover, 115 is external storage, is for driving 
a floppy disk and external storage called CD-ROM, and when external 
storage memorizes instead of holding a control program to RA.M112 
beforehand, it reads and downloads it. 

[00263 The camera server 102 records information, such as control time 
of day, a pan, a tilt, a zoom, and a control client, as one record, 
whenever a camera 101 is controlled by the client. Record of the 
control information of this time series is called a control log. In the 
gestait of this operation, all the records of a control log shall be sent 



from the camera -control server 103 at the time of starting of a client, 
[0027] Next, with reference to the flow chart of drawing 2 , the 
operations sequence in the client which has the above-mentioned 
configuration is explained. 

[0028] Initiation of processing first inputs the field number of partitions 
of a field of a camera 101 like a panorama image which can be photoed 
which copied the whole field which is shown in drawing 7 , and which can 
be photoed by the field number-of-partitions input section 309 in step 
SI 01. As for the field number of partitions, the field 
number -of- partitions input section 309 incorporates the value as which 
a user is the value which operates a keyboard, a mouse, etc., and inputs 
or is held beforehand at the file system, and was inputted by known 
technique in this way. In the gestalt of this operation, although, as for 
the field number of partitions, the number of partitions IV! of a 
lengthwise direction and the lateral number of partitions N shall be 
inputted, this invention is not restricted to this, and it may consider as 
the number of fields after division, or it may make the number of 
partitions immobilization further. 

[0029] At step $102, field division of a panorama image is performed 
based on the field number of partitions inputted by step S 101. A 
panorama image field is divided by this field division as shown in drawing 
3 . in addition, the form of [ in each field divided as shown in drawing. .3 j 
(a line and a train) to the order from the upper Seft of a panorama image 
expressing -- henceforth a field (0 0), a field {0 1), and ... a field 
0, j) and ... it expresses a field (M - 1 , N-1),. 

[0030] Next, in step $103, by the addition information attaching part 
310, the variable which holds addition information about each field of 
MxN is assigned, and the initial value of each variable is set as 0, 
[0031] At step 5104, the time which starts analysis, and the time 



(analysis time zone) which ends analysis are inputted by the analysis 
time zone input section 311. In addition, the alternative made into 
between the whole term also has the time amount which analyzes, and 
the analysis time zone input section 311 changes assigning the time of 
day of the record of the beginning of a control log, and the time of day 
of the last record etc. into the time which starts between the whole 
term, and the time to end using known technique, when between this 
whole term is set up. Thus, the inputted analysis time zone is held to 
the predetermined field in RAM 11 2. In addition, you may make it the 
analysis time zone inputted at this step S104 use what is set up 
beforehand. 

[0032] Henceforth { step S105 J, it processes by reading at a time one 
record of logs of the camera-control server saved at the file system 
from the first record. 

[0033] First, in step $105, when it judges whether the record read into 
the log of a camera -control server exists and the record to read exists, 
it progresses to step S106, and when it does not exist, it progresses to 
step Slid. 

[0034] At step S106, the record reading section 312 divides into each 
field of time amount, a pan, a tilt, a zoom, and a client from a log the 
record read by 1 record read -out and the fieid partition section 313. 
[0035] Then, in step S107, by the analysis time zone check section 314, 
it checks whether the time amount of the fieid divided immediately 
before is in the analysis time amount inputted at step S104, if it is in 
time amount, in progressing to step S108 and being outside time amount, 
it disregards the record, and ft checks about the next record of return 
and a control log to step 5105. 

[0036] it changes into the coordinate value to which the fieid which the 
camera 101 actually photoed was computed, for example, a panorama 



image like the field 401 of drawing 3 corresponded by the parameter 
transducer 315 in [ which can be- photoed ] the field among the fields 
divided at step S106 based on the value of a pan, a tilt, and a zoom at 
step SI 08. This conversion approach uses a known approach, in addition, 
the photography field of the camera 101 changed into the coordinate 
value on this panorama image is called the photography field A. 
[0037] At step S109, an adder unit 316 performs addition processing to 
the variable corresponding to each field held at the addition information 
attaching part 310. This addition is performed based on the following 
conditions. 

(0038] {1} Add 1 to the variable corresponding to the division field (i, j) 
completely included to the photography field A. 

[0039] (2) Add nothing to the variable corresponding to the division field 

(t, j) which does not overlap the photography field A. 

[0040] (3) Add (area which overlaps photography field A)/{area of each 

division field) to the variable corresponding to the division field (i, j) to 

which a part overlaps the photography field A. 

[0041] for example, in the case of the field 401 of drawing 3, to the 

variable corresponding to a field (1 1) and a field (1 2} In order to add 1, 

respectively and to correspond to a field (2 1), a field (2 2), and a field 

(1 3), 0.5 is added, respectively, 0-25 is added to the variable 

corresponding to a field [2 3), and nothing is added to the variable 

corresponding to division fields other than these. 

[0042] After addition termination, in checking whether an unread record 
exists in return and a control log to step SI 05 and existing in it, it 
repeats the above-mentioned actuation, 

[0043] Moreover, when an unread record does not exist in a control log, 
it progresses to step 5110, and the value of the variable corresponding 
to each field held by the addition information-display section 317 by the 



addition information attaching part 310 is displayed on a display 110 
intelligibly for a user. 

[0044] As the method of presentation* although how to display a 
numeric value directly as shown in drawing 4 , the approach of 
displaying by the concentration of a color as shown in drj^ng 5 the 
approach of distinguishing with the class of color, concentration, etc. 
and displaying, although especially drawing is not shown, etc, can be 
considered, as Song as it is the approach of showing the difference of 
the variable of each field, what kind of approach may be used. 
[0045] Processing is completed after display termination at step S11G, 
[0046] Although a series of processings of drawing.2 shall be performed 
by the client (viewer) side with the gestalt of operation of this invention, 
it is also possible to carry out as { perform / processing to $109 is 
completely performed with the camera server 102 or another equipment, 
and may make it transmit an image as shown in drawing 4 obtained as a 
result or drawing 5 to a client side, and / by the camera server 102 / a 
series of processings of d a j oi all j. 

[0047] Moreover, in the gestalt of the above-mentioned operation, 
although the statistics were taken about the record within the analysis 
time amount set up at step SI 04, it is also possible for the number of 
the records to analyze to be set up and for it to be made to take the 
statistics about a set-up number of records instead of setting up 
analysts time amount 
[0048] 

[Other operation gestalten] In addition, even if it applies this invention 
to the system which consists of two or more devices, it may be applied 
to the equipment which consists of one device. 
[0049] Moreover, it cannot be overemphasized by the purpose of this 
invention supplying the storage (or record medium) which recorded the 



program code of the software which realizes the function of the 
operation gestait mentioned above to a system or equipment, and 
reading and performing the program code with which the computer (or 
CPU and MRU) of the system or equipment was stored in the storage 
that, it is attained. In this case, the function of the operation gestait 
which the program code itself read from the storage mentioned above 
will be realized, and the storage which memorized that program code will 
constitute this invention. Moreover, it cannot be overemphasized that it 
is contained also when the function of the operation gestait which 
performed a part or ail of processing that the operating system (OS) 
which is working on a computer is actual, based on directions of the 
program code, and the function of the operation gestait mentioned 
above by performing the program code which the computer read is not 
only realized, but was mentioned above by the processing is- realized. 
[0050] Furthermore, after the program code read from a storage is 
written in the memory with which the functional expansion unit 
connected to the functional expansion card inserted in the computer or 
a computer is equipped, it cannot be overemphasized that it is 
contained aiso when the function of the operation gestait which 
performed a part or ali of processing that CPU with which the functional 
expansion card and functional expansion unit are equipped based on 
directions of the program code is actual, and mentioned above by the 
processing is realized. 

[0051] When applying this invention to the above-mentioned storage, 
the program code corresponding to the flow chart shown in draw ng 
explained previously will be stored in the storage, 
10052] 

[Effect of the invention] As explained above, image pick-up equipment 
can compute which part of the field which can be picturized was 



picturized how much, and can display the result now intelligibly visually, 



DESCRIPTION OF DRAWINGS 



{Brief Description of the Drawings] 

\ > ,« i! ] | l\ is 3 block diagram showing the image pick-up structure of 
a system concerning the gestait of operation of this invention. 
fQra^tisq 2) It fs the flow chart which shows the procedure in the gestait 
of operation of this invention. 

[Drawing 3 1 It is drawing for explaining the division approach of a 
panorama image and the addition approach concerning the gestait of 
operation of this invention. 

\ Drawing 4j St is drawing showing an example of a screen display in the 
gestait of operation of this invention. 

i'Drawinq 5] It is drawing showing another example of a screen display in 
the gestait of operation of this invention, 

[Drawn g Sjit ts drawing showing an example of the screen of the 
computer by which the conventional viewer for controlling a camera is 
operating. 

i.Dfawing 7] It is the screen block diagram which has a panorama viewing 
area and a photography image display field. 
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